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We consider the task of extracting work from quantum systems in the resource theory perspective of ther- 
modynamics, where free states are arbitrary thermal states, and allowed operations are energy conserving 
unitary transformations. Taking as our work storage system a 'weight' we prove the second law and then 
present simple protocols which extract average work equal to the free energy change of the system - the same 
amount as in classical thermodynamics. Crucially, for systems in 'classical' states (mixtures of energy eigen- 
states) our protocol works on a single copy of the system. This is in sharp contrast to previous results, which 
showed that in case of almost-deterministic work extraction, collective actions on multiple copies are necessary 
to extract the free energy. This establishes the fact that free energy is a meaningful notion even for individual 
systems in classical states. However, for non-classical states, where coherences between energy levels exist, we 
prove that collective actions are necessary, so long as no external sources of coherence are used. 
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I. INTRODUCTION 

Thermodynamics forms part of the bedrock of our cur- 
rent understanding of the physical world. It has remained 
unchanged despite huge revolutions in physics, such as rela- 
tivity and quantum theory, and few believe it will ever fail. 
Over time, it has been applied to situations well outside its 
original domain; from black holes [1, 2], to quantum en- 
gines comprised of only a few qubits [3-6]. A fundamental 
question is that of the applicability of thermodynamics to 
quantum systems [7, 8]; it is this question that we wish to 
address in this paper. 

One of the most fundamental questions one would like to 
ask is how much work can be extracted from a system, given 
access to a thermal bath at temperature T. This question, for 
generic quantum systems and Hamiltonians has been investi- 
gated intensively, e.g. in [9-15] yet, until very recently only 
partial results have been obtained and it remained an open 
problem. Very recently however strong general results were 
obtained [16], made possible by employing a new concep- 
tual framework, namely that of "resource theories". 

The advent of resource theories is one of the main 
paradigm shifts which occurred within quantum informa- 
tion theory; the main idea is to bring to the forefront the 
study of resources needed to implement various tasks. The 
archetypal resource theory in this context is entanglement 
theory [17, 18]. However, numerous other examples have 
now been developed, including reference frames [19] , purity 
[20] and asymmetry [21] , which has culminated in a general 
formalised notion of a resource theory [22]. In [23] the au- 
thors introduced an appealing resource theory of thermody- 
namics, based on the class of allowed operations first studied 
in [24]. 

Here we revisit and modify the resource theory frame- 
work of thermodynamics as originally put forward in [23]. 
In this new context we achieve two main results: First we 
prove the second law of thermodynamics. Second, as de- 
scribed in more detail below, we show that free energy is 
a relevant quantity for individual quantum systems. 

The latter result is particularly relevant following the re- 



sults of [16] which call into question the role of free energy 
for individual quantum systems. Classical thermodynamics 
tells us that the total amount of work we are able to extract 
from a system is given by its change in free energy, which 
was also supported by previous partial quantum results [9- 
15]. Yet in [16] it was shown that work equal to free energy 
can be extracted only if we collectively process many copies 
of the same system. When acting on each copy individually, 
the amount of work that can be extracted is generally sig- 
nificantly less than the free energy. These results therefore 
suggest that the free energy is not the relevant quantity for 
individual systems. 

Here we revisit the issue of work extraction and show that 
free energy is a significant quantity for individual systems. 
Our paradigm is similar to that of [16] but differs in an es- 
sential aspect. In [16] they considered almost deterministic^ 
work extraction, from the 'single-shot' viewpoint which has 
received much attention lately [14, 25-28]. Here, in con- 
trast, we will consider average work extraction. We prove 
that there exist simple protocols which extract average work 
equal to the free energy change of the system. Crucially, for 
systems in 'classical' states (mixtures of energy eigenstates) 
our protocol works on a single copy of the system. This es- 
tablishes the fact that free energy is a meaningful notion even 
for individual systems, when their states are classical. 

However, for non-classical states, where coherences be- 
tween energy levels exist, we prove that collective actions 
are necessary, so long as no external sources of coherence 
are used. More precisely, we prove that when acting on an 
individual system the amount of average work that can be 
extracted is equal to the free energy of its decohered state - 
the free energy due to coherences is 'locked' and cannot be 
used. As more copies are collectively processed, some of this 
locked free energy is released - we can extract the free en- 
ergy of the decohered state of n copies, which is larger than 
n times the free energy of a single decohered system. In the 



' Specifically, they require that a deterministic amount of work is extracted, 
except with some small probability f of failure 
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limit of infinitely many copies, the average work extracted 
per copy reaches its entire free energy. Whether or not ex- 
ternal coherent resources allow extraction of work equal to 
the free energy for individual systems, and how to account 
for such resources (given that they may provide free energy 
themselves even without the system) remains an open ques- 
tion. 

The paper is organised as follows. In Sec. 11 we go through 
the preliminaries, including a brief description of the re- 
source theory of thermodynamics in Sec. II A, work storage 
systems in Sec. II B and a proof that the second law holds in 
Sec. III. In Sec. IV we study work extraction from diagonal 
systems, beginning with a motivating example in Sec. IV A, 
before moving onto a full qubit protocol in Sec. IV B. We dis- 
cuss a special case in Sec. IV C, present a full protocol for ar- 
bitrary dimension systems in Sec. IV D and prove optimality 
in Sec. IV E. In Sec. V we show how work can be extracted 
from coherence by acting collectively on multiple copies of 
the system. We finish by briefly discussing how the results of 
this paper can be understood from the perspective of 'virtual 
temperatures' in Sec. VI, before concluding in Sec. VII. 

II. PRELIMINARIES 

A. The resource theory of thermodynamics 

The first ingredient in a resource theory is a set of free 
resources. By free we mean that we have an unlimited sup- 
ply of this resource, since it is deemed easy to acquire. In 
the present context of thermodynamics this free resource is 
a thermal hath at temperature T . More precisely, we assume 
that we have an unlimited supply of finite-dimensional sys- 
tems, with any desired Hamiltonian H, in their thermal state 

rp{H) = ^e-P" (1) 

where jS — l/T is the inverse temperature^, and 
2^ = tr{e~l^^) is the partition function. 

The second ingredient is a set of allowed operations, those 
which one has the ability to perform with ease. In the 
original resource framework these allowed operations were 
any energy conserving unitary transformation. In particular, 
any unitary operation which commutes with the total (non- 
interacting) Hamiltonian of all the systems under consider- 
ation. This allows one to transform systems in a controlled 
way, but without admitting an external source of energy. 

However, we will also introduce an additional element 
into the resource framework, a work storage system, whose 
sole purpose is to provide and store work for thermo- 
dynamic transformations. In the next section, we will 
place some additional constraints on the allowed operations. 



^ We set kg = l throughout for convenience 



which prevent us from 'cheating' by using work storage sys- 
tem for other purposes (e.g. by using it as a cold reservoir 
in a heat engine), and allow us to use the same work storage 
system for multiple thermodynamic protocols. 

Given these ingredients, any additional system which is 
not in thermal equilibrium with a bath at temperature T is 
a useful resource. The question that remains is to quantify 
how useful different resource states are. 

B. Work storage systems 

One way to quantify the usefulness of different resource 
states is to find a transformation from every resource state 
to some fiducial resource which allows for comparison in a 
well-defined and easy manner. In the resource theory of en- 
tanglement, for example, one can quantify the entanglement 
of a state by the optimal asymptotic number of maximally 
entangled states that can be created per resource state, or in 
other words the optimal rate at which states can be converted 
into maximally entangled states. Different states will have 
different optimal rates, and thus the rate quantifies how use- 
ful they are. We seek here an analogous fiducial resource for 
thermodynamics . 

Work is the desired output in this case, and different states 
can produce work at different rates. Because we wish to 
study a closed quantum system, with conserved total en- 
ergy, we desire a system where we can store the work ex- 
tracted from resource states. Similarly to entanglement the- 
ory, where the maximally entangled state is chosen for con- 
venience, here we wish to find a work storage system which 
we deem to be most convenient. 

In previous work [16] a candidate was put forward - rais- 
ing a qubit deterministically from its ground state to it's ex- 
cited state. This qubit was termed a wit, short for work bit. 
However, choosing the energy gap of the work bit requires 
advance knowledge of the work to be extracted, and this 
model does not translate well to non-deterministic work ex- 
traction, which we will be interested in here. Furthermore, 
we would prefer to be able to use a single work storage sys- 
tem as a 'battery' capable of gaining and expending work in 
multiple thermodynamic processes. 

The alternative work storage system we will consider here 
is a suspended weight, which is raised or lowered when work 
is done on or by it. In particular, we will consider a quan- 
tum system whose height is given by the position operator x, 
with Hamiltonian — mgx representing its gravitational 
potential energy^. For simplicity, we choose mg — 1 J/m, 
such that the value of x directly denotes the work stored by 
the mass. Such a system has a long history of being used as a 
work storage system in classical thermodynamics [29] . 



' Note that it is not strictly necessary for the height of the weight to be a 
continuous degree of freedom. In Appendix G we show that the weight 
can be replaced by a system with discrete equally-spaced energy levels. 
This introduces a small error in the results, but this can be made as small 
as desired by appropriately scaling the spacing of the weight. 
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We will place two additional constraints on the allowed 
dynamics governing interactions with the weight: 

(i) The average amount of work extracted in an allowed 
protocol must be independent of the initial state of the 
weight. 

(ii) All allowed unitaries should commute with transla- 
tion operations on the weight. This reflects the trans- 
lational symmetry of the weight system, and the fact 
that only displacements in its height are important. 

These constraints are intended to prevent us from 'cheat- 
ing' by using the weight for purposes other than as a work 
storage system (e.g. as a cold reservoir, or a source of co- 
herence). For example if the weight starts in a pure state, it 
has zero entropy, so one needs to be careful to avoid unwit- 
tingly using this as a source of free energy, in addition to the 
system. Constraint (i) encapsulates this requirement. 

Constraint (ii) is a bit more subtle. On the one hand, it is 
very plausible that it is a consequence of constraint (i). We 
however have not been able to show this. On the other hand, 
even if it does not follow from (i), we would still like to as- 
sume it, as it seems wrong to use properties of the weight in 
the protocol, even if they do not affect the work extracted. 

Furthermore, constraint (i) ensures that we can use the 
same work storage system for multiple thermodynamics pro- 
tocols (or on several copies of the same state) without having 
to worry how the initial state has been modified by earlier 
procedures. 

As we are free to choose any initial state of the weight 
due to constraint (i) above, for simplicity we will usually 
take the initial state of the weight to be a narrow normalised 
wavepacket |0).^ centred on the origin (i.e. (0|x|0) — 0). 
When the same wavepacket is raised above the origin by a 
distance a, we will denote the state by \a)^ — r^|0)^, where 

is the translation operator"*. 

III. THE SECOND LAW 

We now show that the second law of thermodynamics 
holds in our framework, by proving a probabilistic version 
of the second law - that there is no protocol which extracts 
a positive quantity of average work from a thermal bath (i.e. 
that there is no way on average of turning heat into work) 
[30]. To show this we will use proof by contradiction. 

Consider a thermal bath at temperature T and the weight, 
i.e. there is no additional system out of thermal equilibrium. 

Let us first consider the energy changes during the proto- 
col. Suppose that we are able to extract work from the bath 
and store it in the weight, > 0. The average energy 

of the thermal bath must change by AEg — —AE^ due to 
energy conservation. 



Now consider the entropy changes during the same pro- 
tocol (in particular, the changes in von Neumann entropy 
S{p) — — tr(^log^)). As the bath and weight are initially 
uncorrected, their initial entropy is simply the sum of their 
individual entropies. Unitary transformations conserve the 
total entropy, ASg^^ — 0. However, as correlations can form 
during the protocol, the sum of the final entropies of the 
bath and weight can be greater than the sum of their initial 
entropies (as the entropy is subadditive). This means that 

A5s+AV>AV-0 (2) 

Given an initial thermal state for the bath (with positive 
temperature), any change of the state which reduces its aver- 
age energy must also reduce its entropy^, AS^ < 0. However, 
within our framework all allowed protocols are such that the 
average work extracted is independent of the initial state of 
the weight; we are therefore free to choose any initial state 
of the weight we like. Consider now that the initial state 
of the weight is a very wide wavepacket. We show in Ap- 
pendix B that the entropy change of the weight in this case 
can be made as small as desired, in particular we can make 
AS^ff < \ASg\. This would result in violating (2). Hence 
there is a contradiction, and thus there is no way to extract 
work from the bath. 



IV. EXTRACTING WORK FROM DIAGONAL SYSTEMS 

We will begin our exploration of work extraction by con- 
sidering the special case of extracting work from systems 
whose states are diagonal in the energy eigenbasis. This rep- 
resents systems which are essentially classical, since coher- 
ence plays no role, and states are simply mixtures of energy 
eigenstates. We will present a protocol which extracts work 
equal to the change in free energy of the system. In contrast 
to existing protocols, here our protocol will take one copy of 
the system, and extract average work equal to the free energy 
of the system. 

The protocol contains at its core a single elementary build- 
ing block which is able to extract a vanishing amount of 
work blue, with maximal efficiency. The full protocol con- 
sists of many repetitions of this one step. We shall present 
first this building block in a motivating example and then 
show precisely how it is used to build the full protocol. In 
the main text the emphasis will be on the results of the pro- 
tocol, with the more detailed analysis provided in the appen- 
dices. 



"* The translation operator is = exp{—iap/ i), where p is the usual mo- 
mentum operator satisfying [x,p] = it. 



' This follows from the fact that the thermal state is the maximal entropy 
state with given average energy. For more details see Appendix B 
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A. A motivating example 

Let us consider the task of performing the following trans- 
formation on a single qubit 

i (3) 

whose Hamiltonian is — (1| and where Sp <C 1- 
That is, we wish to consider the small transformation from 
a diagonal state to a nearby diagonal state. The initial and 
final state differ in free energy, and hence the goal is to ex- 
tract an amount of work as close as possible to this differ- 
ence, namely 

^{{E)p-TS{p))-{{E)^,-TS{p')) 
..Sp{E,-TS[{p)) (4) 

where Fp{a) — — TS{a) is the free energy of a with 
respect to a bath at inverse temperature /?, {E)^ — tr (H^a) 
is the average energy, S^(^) — — ^ log^ — (1— ^)log(l— ^) is 
the (classical) binary entropy, S'^{q)— and we have taken 

the first order expansion in Sp to arrive at the final line. We 
shall now see that to first order we can extract exactly this 
amount of work from the system. 

To do so let us bring in a thermal state from the bath - the 
free resource at our disposal - and choose its Hamiltonian 
such that the population in the excited state is p — Sp. For 
thermal qubits the relation between excited state population 
r and energy spacing Eg is 

E, = Tlo^(^^^=TS'^ir) (5) 

thus we will choose the Hamiltonian of the bath qubit to be 

E, = TS[{p - Sp) ^ TS[{p) - SpTS'^ip) (6) 

Let us take the weight to be prepared initially in the state 
|0) of zero average energy, and consider applying an energy 
conserving unitary transformation U which interchanges 

\0)Jl)^\xl^\l)jO)^\x + Es-E,l (7) 
for any x, whilst leaving all orthogonal states unchanged^. 



' U can be expressed in terms of the translation operator as 

Z7 = |io)(oi|<g>rA-F|oi){io|(8ir_A-F(|oo){oo|-F|ii)(ii|)(g>l, 

where A = £5 — £^ . Note that this commutes with the free Hamiltonian 



It is the change in average energy of the weight which is of 
interest. A straightforward calculation (given for complete- 
ness in the Appendix) shows that this is given by 

S{E)^ ^SW^ Sp{E,-E,) ^ Sp{E, - TS[{p)) (8) 

which is equal to SFp to first order in Sp. 

Thus we observe that if we wish to to make a change of 
state from p to p' , a way to proceed is to bring in a qubit 
from the bath in the state Tp{Hg) — p'. Whenever p is 
not the thermal state (given it's Hamiltonian Hg), we find 
that Hg ^ //j, and therefore there is a difference in energy 
between the excited states of the two qubits. It is thus not 
possible to swap the state of the two qubits using an energy 
conserving unitary. However, by bringing in the weight we 
can perform the unitary (7) which is energy conserving, and, 
at the level of the reduced states of the system and bath, in- 
deed performs a swap. The system therefore ends up in the 
desired state p', and we find that the change in average en- 
ergy of the weight, when the state of the system and bath 
are close, approaches exactly the change in free energy of the 
system. 

B. Full qubit protocol 

The above insight can be used to build a full protocol 
which is able to extract an amount of work approaching the 
free energy change in transforming a system from a state p 
to its thermal state Tp{H^). 

The basic idea is that, since in making a small change of 
state we have seen that the work extracted approaches the 
free energy change, we can divide a large change of state 
into many small changes and at each stage extract the desired 
amount of work. 

Therefore, let us fix an integer N ^ I, and consider N 
thermal qubits T^p\Hf), k^\,...,N, 

rJJ)(/4'))-(l-rW)|0)^(0| + r(^)|l)^(l| 

where p^^ — is the excited-state probability in the 

thermal state Tp{H^). This collection of bath qubits have 
excited-state probabilities which vary linearly from that of 
the initial state of the system p<^to that of the thermal state 

of the system t^(//^), in increments of ^-^-^j^. We will ap- 
ply, in turn, the sequence of unitary transformations { U^^^, 
where U^^'^ acts on bath qubit k, system and weight and 
swaps the states 

|0)Jl)Jx) --|l)jO)Jx+£,-£f) (10) 

whilst leaving all other orthogonal states unchanged. 

Assuming once again that the weight starts in the state 
|0) , it is the final state, and in particular the final average 
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energy of the weight which is of interest, as the number of 
steps N tends to infinity. In Appendix D we calculate explic- 
itly this state in the asymptotic limit. The result is that the 
final reduced state in the infinite limit, denoted is 

w 

n-^(i-;,)|riog(±^))jriog(±^)l 

+/,|riog(^))(riog(^)l (11) 

The average energy is thus 

(£>:-r(,iog(^)+(i-,)iog(±j)) 

- TD,{p\\Pe,)^Ff^ip)-Ffl i^f^iH,)) (12) 

where D^{p\\p^^) is the relative binary entropy. 

We observe that the average energy of the weight at the 
end of the protocol, and hence the average work extracted, 
approaches precisely the free energy difference in the asymp- 
totic limit of infinitely many thermal qubits. Although this 
is promising, it should be noted that the final distribution of 
the weight does not have the form one may intuitively have 
asked for (i.e. a peak around a single value, at the free energy 
itself). Instead we find that the solution has perfect corre- 
lation between the initial state of the system and the final 
energy of the weight. It is worth noting that this interesting 
distribution coincides with the results found in [14] where, 
even though the details of the allowed transformations differ, 
it was shown that for classical systems, optimal work extrac- 
tion protocols converge on this distribution in probability. 

Note also that in the large N limit, although many thermal 
qubits are required, each of them is only slightly perturbed 
by the process. 

Finally, we consider the case of n independent copies of 
the system - i.e. the macroscopic limit. To do so we sim- 
ply repeat the protocol above on each qubit separately, us- 
ing a single weight to store the work. In each case we have 
seen that the weight is transformed from a single peak (at |0) 
above) to two peaks. Since the protocol is linear, it follows 
immediately the the final distribution of the weight will be 
the w-fold convolution of the above distribution for a single 
qubit. From the central limit theorem one concludes that 
the final average energy of the weight is 

{E)^^n{Ff,ip)-FpiT^iH,))) (13) 

with fluctuation of the order ./n. For large n these fluctu- 
ations will be insignificant compared to the average, and we 
obtain an almost deterministic quantity of work, with the 
amount of work extracted per copy of the system equal to 
the free energy difference. 

The results presented here are completely consistent with 
those presented in [23] . It should be noted however the stark 
difference in which the two protocols achieve the same goal. 
In [23] the analysis first considers all n systems together and 
uses ideas from information theory to compress information 
within large typical subspaces. Here, on the other hand, each 



qubit is manipulated separately and nowhere is the idea of 
a typical subspace ever introduced, nevertheless they both 
achieve the same end result. 



C. Special case: isothermal expansion 

The protocol outlined in the previous subsection is the 
general protocol which allows for the extraction of work 
from an arbitrary diagonal state of a qubit, for any given 
Hamiltonian. There is one particular choice of state that will 
be particularly important in later sections. As such, we shall 
briefly look at it in more detail. 

Consider a qubit for which the Hamiltonian vanishes 
(E^ — 0) and for which all the probability is initially in the 
state |0)^ (p — 0). Since the Hamiltonian vanishes, the sys- 
tem lives in a degenerate space, and since it is pure we have 
maximal information about the state of the system. This in- 
formation can be used to extract work from the heat bath. 
Since all states of the system have equal energy, it is clear 
that the system provides only information, whilst it is the 
bath which provides the energy. 

For a degenerate system the equilibrium state Tp{0)= jt, 
thus after applying the protocol from the previous section, 
in the asymptotic limit of infinitely many bath qubits, the 
final state of the weight is given by 

n^-|riog2)jriog2| (14) 

corresponding to the extraction of an amount of work W — 
7'log2 from the system. This is an analogous process to the 
isothermal expansion of a single-molecule gas from one side 
of a box into the full volume, as discussed in Szilard's well- 
known treatment of Maxwell's demon [31, 32]. 

It should be noted that contrary to the previous subsec- 
tion, where the final state of the weight was found to consist 
of two peaks, in this special case of a pure initial state it con- 
sists of only a single peak. Thus it is not necessary to go to 
the many-copy regime to extract a deterministic amount of 
work in this case. 



D. Extracting work from diagonal quantum states of 
arbitrary dimension 

To conclude the analysis of diagonal systems it is now nec- 
essary to move beyond qubits, to quantum systems of arbi- 
trary finite dimension d, and arbitrary Hamiltonians. 

Our strategy is to connect a pair of energy levels in the sys- 
tem to a sequence of thermal qubits in the bath, shifting the 
occupation probability between these levels as in the qubit 
case (Sec. IV B). We then repeat this process for different 
pairs of levels until we have the desired final state. As the 
amount of work extracted in each step does not depend on 
the initial state of the weight (as proven in Appendix A), we 
can consider each step separately and simply sum the total 
work extracted. 
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An important difference from the qubit case is that the 
occupation probability of the two levels in the system that 
are coupled to the bath at any given stage need not sum to 
unity. For example consider a qutrit (or larger system) in the 
state 

ps^{l-p- ^)|0)^(0| +^|1)^(1| + p\2)l,2\, (15) 

where we wish to shift a small amount 8p of probability 
from |0)^ to |2) . To do this, we take a thermal qubit with 
excitation probability {p + 8p)l{\ — q), so that the ratio of 
occupation probabilities in the bath qubit is the same as in 
that in the desired final state of the system. We then apply 
the unitary 

l°)j2)J^l^|l)J°)J^+^2-£«l (16) 

where £2 the energy of the state |2) , and all orthogonal 
states are left unchanged. We show in Appendix E that the 
change in the average energy of the weight during this pro- 
cess is equal to the free energy change of the system, to first 
order in 8p . 

From this it is straightforward to extend the qubit proto- 
col to arbitrary diagonal states. For sufficiently large N we 
can choose a sequence of -|- 1 states for the system where 
two adjacent states differ in occupation probability between 
a pair of levels by ff{l/N), with the first and last states equal 
to the initial state of the system and its thermal state respec- 
tively^. We then pick the Hamiltonian for N thermal qubits 
such that unitaries of the form (16) take the reduced state of 
the system from from one state in the sequence to the next. 
This is done by taking the thermal qubits to have popula- 
tions equal to those of the pair of levels of interest of the 
next state in the sequence, after renormalising. In the limit 
A/ — »■ 00 the average amount of work put into the weight 
equals the free energy change of the system, regardless of the 
precise choice of path. 

Interestingly, an equivalent protocol would work for tran- 
sitions between any two diagonal states, p and a, extracting 
an average amount of work equal to Fp{p) — Fp{a). This 
implies that creating a diagonal state p from a thermal state 
costs the same average amount of work as can be extracted 
from p when it is thermalised. In this sense thermodynamic 
transitions between diagonal states are reversible This dif- 
fers from the results of [16], who show that such transi- 
tions are irreversible when considering (almost) determinis- 
tic work extraction, rather than average work. 



'' For example, we could first shift probability from all energy levels with 
higher probability in ^ 5 than in Tp{Hg) to the |0)^ state, then move prob- 
ability from |0)^ to the remaining levels, using N l{d — 1) steps for each 
pair of levels. 

* However, note that if a state is thermalised and then recreated using our 
protocol, the fluctuations in the position of the weight will increase. 



E. Proof of optimality 

We now show that the above protocol is optimal. In par- 
ticular, we will argue that the maximum free energy that can 
be extracted from a transition between diagonal states p and 
a is Fp{p) — Fp{a), using a modification of our proof of the 
second law (in Section III). 

Suppose that we have a protocol which extracts average 
work Fp{p) — Fp{a) + 8 (where 8 > Q) when the system 
is transformed from p and a. We can then use the above 
protocol to return the state from o" to ^ in a finite number 
of steps, extracting work Fp{a)—Fp{p) — (, where we choose 

the number of thermal qubits such that e is in the range < 
e < 8 /2. The net effect is that a positive average work > 8 /2 
is extracted into the weight, and the system begins and ends 
the combined procedure in the same state p. 

Considering total energy conservation for the combined 
protocol, we note that the average energy of the bath must 
have decreased by at least 8/2, which means that the bath's 
entropy must also have decreased by a finite amount. How- 
ever, the system does not change in entropy, and the change 
in entropy of the weight can be made as small as desired by 
choosing its initial state to be a sufficiently broad pure state 
(see Appendix A). Hence entropy conservation cannot be 
satisfied by our hypothetical protocol, and thus no protocol 
exists which extracts more average work than the free energy 
change. 

V. EXTRACTING WORK FROM COHERENCE 

So far all of our discussions have involved only states 
which are diagonal in the energy eigenbasis and the protocol 
presented involved shifting probability only between these 
energy eigenstates. We can of course consider more general 
states, and ask the question of how to extract the maximum 
amount of work from such states. 



A. Motivating example 

As a motivating example, let us consider a system with 
Hamiltonian — £^|1) (1| prepared initially in the pure 
state 

This state has the same average energy as the thermal state 
Tp{H^), however, since this state is pure, it has zero entropy 
and hence its free energy differs from that of the thermal 
state. Thus one would like to extract work from this state, 
with the limit on extractable work given by 

W<F{/^)-F{Tp{H,))=TSXp,,) (18) 

Previously we were able to extract work from single copies 
of diagonal states. However, we show in the next section 
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that it is impossible to extract work from a single copy of 
\<p)^ given the assumptions of the framework. This is similar 
to the analysis of [16] where they also found that the state 
(17) is useless for (almost) deterministic work extraction. 

However, it is only a single copy which is a useless re- 
source; two copies can be used to extract work, although the 
amount is less than that given by (18). The important point 
is the way in which work is extracted, which will suggest 
a different way in which one can understand an asymptotic 
protocol (in the number of system qubits) able to extract the 
optimal amount of work. 

Consider two copies of the state li/*)^, which written out 
in full is given by 

\'P)^' - (1 - /'e,)|0)JO), + V/'e,(l-/'e,)(|0)Jl), 

+ |l)JO),)+/'e,|l>,|l), (19) 

Let us consider that we now dephase this state in the energy 
eigenbasis, so called collective-dephasing. We can achieve 
this in two ways, either by allowing the state to evolve under 
its Hamiltonian freely for some unknown duration of time, 
or more systematically by applying controlled-Z operations 
between maximally mixed (therefore degenerate) bath qubits 
and the system. Note that both of these are energy conserv- 
ing unitaries. In either case, at the end of the dephasing the 
state p is 

+ <|1)J1),,(1|,(1| (20) 

where \<p+)^ = j= (|0)J1)^ + |1)J0) J . We note that since 
|0) |1)^ and have the same energy, the definite phase 

between them is preserved. The important point is that 
when considering the combined system we find that we have 
a two-dimensional degenerate subspace and within this sub- 
space we are in the pure state | <p'^)^ , and not the orthogonal 

state 1^^-)^ = (|0)J1)^ - |1)J0)J. Thus we have knowl- 

edge that we are with certainty in one of two orthogonal 
states and we can use this information to extract work from 
a thermal bath by allowing it to 'isothermally expand' into 
the full subspace. Randomising these two states brings the 
pair of qubits to their thermal state. We can thus apply the 
analogue of the protocol in Sec. IV C, coupling only the two 
states inside the degenerate subspace to the thermal bath, and 
it follows immediately that the final average energy of the 
weight, in the asymptotic limit, is 

{E)^=2peqi^-peq)Tlos2 (21) 

Except for the limiting case p^^ — 0, corresponding to the 
unphysical condition — »■ oo, this value is strictly less than 
the change in free energy of two system qubits, 

2pe.i^-pe.)Tlos2<2TSXpJ (22) 



This inequality is due to the fact that the collective-dephasing 
changed the entropy of the system but extracted no work 
in the process. One may wondering therefore why this op- 
eration is considered in the first place. In Appendix F we 
show that we can apply the same analysis, including the 
collective-dephasing, to n copies of and extract, in the 
asymptotic limit w — »■ oo, work equal to the free energy 
change nTS^{p^^). This is possible since, as we also show, 
collective-dephasing increases the entropy of n systems by 
an amount which grows as log(w -|- 1), which becomes neg- 
ligible in the asymptotic limit. We thus see that coherence 
between states of different energy in fact plays no thermody- 
namic role asymptotically in work extraction^. 

Altogether this highlights an essential difference between 
diagonal and non-diagonal states; When ^ 0, the state of 
multiple qubits in a diagonal state will be maximally mixed 
inside each energy eigenspace. However, for non-diagonal 
states, these subspaces take on non-trivial states, and work 
can be extracted from them by allowing them to 'isother- 
mally expand' into the full subspace. 

B. General work extraction protocol 

We now present a general strategy to extract work from n 
copies of an arbitrary state p, of arbitrary dimension d. It is 
helpful to divide the protocol into three steps: 

(i) Collectively dephase the state p®'^ in the joint energy 
eigenbasis. 

(ii) Allow the resulting state to 'isothermally expand' in- 
side each energy eigenspace, until it equals a>®", where 
CO is the state obtained by dephasing p in its energy 
eigenbasis. 

(iii) Individually transform each copy of co into Tp{H^). 

It follows from the results of Sec. IV D that steps (2) and 
(3) can be performed whilst extracting an average amount 
of work equal to the free energy change. The free energy 
change in the first step is not captured as work, but is simply 
lost. However, we show in the Appendix F that the amount 
of work lost in this step is at most T{d — l)log(w -|- 1). 

The average amount of work extracted per copy of the 
original system is therefore 

T{d - 1) 

8W > Fp{p) - Fp{Tp{H,)) - -^—^ log(« + 1). (23) 

In the limit as w — »■ co, we therefore extract an average work 
per copy of p equal to its free energy change, as desired. 

If we only have a single copy of the system, the amount 
of work we can extract from p is given by the free energy 



' In the other direction, that of creating non-thermal states from a supply 
of work, in [23] it was shown that a phase reference (e.g. a large coherent 
state) is consumed at a sub-linear rate in this process. 
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change of the decohered state, Fp{co) — F p{T p{Hy)). This 
can be obtained by first dephasing p into co and then using 
the protocol in Sec. IV D. We now show that this is optimal, 
following the approach given in [16]. 

Firstly, note that as we require the average work extracted 
by a protocol to be independent of the initial state of the 
weight, we are free to choose that state however we like - 
here we choose it to be a very narrow wavepacket centred on 
zero. Now consider a decomposition of the total state space 
into subspaces, each of which has total energy (of the sys- 
tem, bath and weight) close to one of the energy eigenvalues 
of the system and bath'°. Note that any work extraction pro- 
tocol can be followed by a transformation which decoheres 
the state with respect to these total energy subspaces, with- 
out affecting the average work extracted. However, this de- 
cohering operation commutes with the unitaries used in the 
protocol, so we can move it to the beginning of the protocol 
without changing the work extracted. At the beginning of 
the protocol, this operation has the sole effect of decohering 
the system in its energy eigenbasis (changing p to co). Hence 
the protocol extracts the same amount of work as it would 
have if it had operated on co. 



VI. PERSPECTIVE USING 'VIRTUAL TEMPERATURES' 

Consider the model of the smallest possible heat engines 
[4, 33], consisting of two qubits, one with energy spacing 
£j in thermal contact with a bath at temperature Tj, and 
a second with energy spacing E2 in contact with a bath at 
Tj. As a composite system this pair of qubits is not in a 
global thermal state. Nevertheless, let us assign a 'virtual 
temperature' to each transition via the identification [33] 



Pig)~ 



(24) 



where p{e) and p{g) are the probability of being in the 'ex- 
cited' state (the state of higher energy) and ground state (the 
state of lower energy) respectively, with and being 
their energy eigenvalues, and /3„^ — 1/ is the 'inverse vir- 
tual temperature'. For the case in hand, the virtual inverse 
temperature for the states |0) |1)^ and is 

_ S'^ip,)-Slip,) _ E,/3,-E,/3, 

where we have denoted the probability for qubit i to be in 
the excited state by p^, and we have used the relation S'^{p) — 
/3E for a thermal state. 

The motivation for introducing the concept of virtual 
temperatures is that for the smallest machines it gives a con- 
cise characterisation of their behaviour; the function of the 



' In particular the i''^ subspace corresponds to the total energy E lying in 



the range ^' f' ' <E < ^' 



vhere E- are the energy eigenvalues of 



2 — — 2 

the system and bath. Furthermore we choose the width of the weight's 
initial wavepacket to be narrower than the smallest subspace. 



machine is determined by the virtual temperature - refriger- 
ator, heat pump or heat engine, if colder, hotter, or negative 
temperature respectively; Carnot efficiency is approached 
when the virtual temperature approaches the external tem- 
perature for the refrigerator and pump, and when approach- 
ing minus infinite temperature for the heat engine. 

It is the final machine mentioned, the heat engine, which is 
relevant here, since this is the machine which produces work. 
We can think of the system qubit and bath qubit together to 
be a two-qubit heat engine and that the operating point of 
the protocol is the Carnot point of the engine. 

Let us return to the motivating example of Section IV A. 
Our system qubit had spacing E^ with excited state proba- 
bility p, whilst the bath qubit had spacing Eg with excited 
state probability q. Let us rename the state — |0) 

and — |1) • With this renaming, the interaction (7) 

becomes 



|l)Jx),_^^|0)Jx + £J^^ 



(26) 



where E^^ —E^—Eg is the spacing of the virtual qubit. Thus 
from this perspective it is explicit that the unitary is the 
one which exchanges energy from the virtual qubit into the 
weight, analogous to the Hamiltonian of the smallest heat 
engine [33]. The operating point of the protocol was to 
choose Eg such that q — p — Sp. In this regime, to first 
order, the inverse virtual temperature becomes 



Es-TS[{p) 



(27) 



where S"{p) — — 7^ -!- < 0. Thus the inverse virtual tem- 

c / l-p p — 

perature becomes vanishingly small and negative as 8p — »■ 0, 
which is exactly the Carnot limit of the small heat engine. 

The picture that one obtains from this perspective is that 
the reason why any state which is not a thermal state at tem- 
perature r is a resource is because the composite system of 
resource state + thermal state contain non-trivial virtual tem- 
peratures. One can extract work from a system approaching 
its free energy when the only exchanges between the com- 
posite system and weight involve virtual qubits whose in- 
verse temperatures become negatively infinite. 

Finally, we conclude by noting the protocol for systems 
with many energy levels becomes easier to explain using this 
perspective. A non-thermal state will have transitions (i.e. 
pairs of levels) at many different temperatures, and each pair 
needs to be bought to the same temperature in the thermali- 
sation process. In the protocol the bath qubits interact only 
with a single pair of levels at a time. To approach reversibil- 
ity it must be the case that any systems which interact only 
differ in temperature by an infinitesimal amount, but this is 
exactly the condition enforced by choosing the renormalised 
probability of the pair to be close to the bath qubit pop- 
ulations. Finally, the unitary which is applied is the basic 
thermalising unitary and the energy exchanged in the limit 
is precisely the free energy. 
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VII. CONCLUSIONS 

To summarise, in this paper we have analysed the funda- 
mental laws of thermodynamics using the recently proposed 
concept of resource theories. We proposed an alternative re- 
source theory which differs in certain aspects from the orig- 
inal one. In this conceptual framework we have proved a 
number of results. First we proved the second law of ther- 
modynamics. Second we proved that for systems that are di- 
agonal in the energy eigenbasis, but not at equilibrium with 
the thermal bath, we can extract work equal to the free en- 
ergy by processing each system individually, hence showing 
the free energy is a relevant quantity for individual systems. 
Third, we proved that when systems are not diagonal in the 
energy eigenbasis, i.e. they have coherences between differ- 
ent energy eigenstates, it is not possible to extract work equal 
to the free energy by processing them individually. Work 
equal to the free energy can however be extracted if we allow 
for collective processing of such systems (in the asymptotic 
limit of many copies). 

A number of important questions open immediately. 
First of all, whether the assumptions which underlie our 
resource theory framework are too restrictive. In particu- 
lar, this may be the reason why we cannot extract the entire 
free energy by processing single systems with coherences be- 
tween different energy levels. Indeed, given our assumptions 
we are very limited in how we can access and manipulate 
the relative phase between two different energy levels, hence 
we cannot interfere them in a controlled way. As such, for 
all practical purposes the different energy levels behave as if 
they were decohered; it is precisely the free energy of this 
decohered state that is the maximum we can extract in our 
framework. To be able to interfere different energy levels, 
i.e. to control their relative phase, we need a "frame of ref- 
erence" for it. One way to look at this is that we need some 
other resource with coherent superpositions between energy 
levels Another way to express this is that we essentially 
need a clock: the phase between two energy levels varies in 
time, so a "frame of reference" for it is essentially a clock. 
When collectively processing many copies the different sys- 
tems act effectively as reference systems for each other. For 
individual processing however we essentially need to add an 



external clock. In our present framework we did not include 
such a clock since we were not able to guarantee that one 
cannot unwittingly cheat by using the clock itself as a source 
of free energy. It is conceivable however that a more careful 
formulation of the resource theory would permit integrat- 
ing a clock in a consistent and controlled manner. In this 
case, it may be possible that work equal to the free energy 
can be extracted from all quantum states by only processing 
individual copies. 

Second, while in the above we asked if we can relax some 
of the constraints imposed in the resource theory, for ex- 
ample by including a clock, we must also enquire whether 
we may indeed need to strengthen some of the constraints. 
In particular, one may be concerned that we have used uni- 
tary transformations as opposed to Hamiltonian evolution. 
Unitaries imply controlled evolution, i.e. turning on and 
off interactions at precise time intervals. One may wonder 
whether this does not require some free energy to achieve. 
If this is the case, then it is only an illusion that we have ex- 
tracted work equal to the free energy from the system, since 
we had to pay to implement the process. Although such a 
detailed analysis is missing, the fact that all of the results ob- 
tained within the resource theory framework so far are con- 
sistent with our expectations is an implicit indication that 
the assumptions are indeed justified. 

To conclude, the resource theory framework seems to be 
a natural and powerful way to approach thermodynamics. It 
has already delivered significant results and we believe that 
further investigation along these lines will lead to a much 
deeper understanding of the foundations of thermodynam- 
ics. 
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APPENDICES 



Appendix A: Independence of the work on the initial state of 
the weight 



In each step of our protocols in which work is extracted, 
the state of a thermal qubit is swapped with a pair of energy 
levels in the system, with a corresponding translation of the 
weight in order to conserve total energy. Consequently, each 
work-extraction step can be represented by a unitary trans- 
formation of the form 



£.-£. 



(Al) 



where the states are an orthonormal basis of energy 
eigenstates for the system and the relevant portion of the 
bath, such that {Hg +H^)\i) — E-\i), is the translation op- 
erator on the weight, and H^y is a permutation matrix. Fur- 
thermore, apart from the initial decohering of non-classical 
states (discussed in Section V), which is entirely independent 
from the weight, the entire protocol can be cast in this form. 

It is easy to see that all such unitaries commute with trans- 
lations on the weight. We now show that the average work 
extracted by a unitary of this form does not depend on the 
initial state of the weight (even if it is initially correlated with 
the state of the system). Let us denote the initial state of the 
system, bath and weight by the density operator p. The av- 
erage work extracted is given by 



{W)=tr{H^UpU^)-tr{H^p). 
^tr{{u'H^U-H^)p) 



(A2) 



where H^, — 1^^ g) is the Hamiltonian of the weight (de- 
fined for convenience as an operator on the entire system). 
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Now note that 

u'H^u^Y^iiki^,j\l){k\i){}\ ® (r^^.^^xr^ 

ijkl 

-En./n,;|/)(;l®(r£__£,ir£^_£_) 

i jl 

= En.;l;)(;l®(r£,-£,ir£.-£.) 

= H^+^Xi,. [E^ -£,) |;)(;| ® 1.^ (A3) 

where in the third hne we have used the fact that for permu- 
tation matrices Yi^iYi^j — H^jSji (where <5'y; is the Kronecker 
delta function), and in the fourth Hne we have used the fact 
that T_^xT^ — X +a l^. Inserting this expression in (A2), we 
obtain 

{W)^tr,, |^(l]n,; {E, \j){j\)psj}j (A4) 

where p^s — ^''^w(p) reduced density matrix of the sys- 
tem and bath. Hence the average amount of work extracted 
is independent of the initial state of the weight as desired. 

Note that the most general energy-conserving unitary 
transformations which commute with all translations on the 
weight have the form 

U^Y^u,^\i){j\®r^^_,_ (A5) 

where is an arbitrary unitary matrix. However, for such 
unitaries the work extracted would generally depend on the 
initial state of the weight. 

Appendix B: Proof of second law of thermodynamics 

In this appendix, we provide further details for our proof 
of the second law in Section B. 

We first argue that any reduction in the average energy 
of an initially thermal state (with positive temperature) must 
also yield a reduction in its entropy. We will only need to use 
the fact that a thermal state is the maximal entropy state with 
a given average energy. If a system starts in a thermal state 
and is transformed to a final state with fixed average energy, 
the entropy change ASg will be maximised when the final 
state is also thermal. In the case where the average energy 
decreases, and the initial state has positive temperature, the 
final state will be a thermal state of lower temperature, and 
thus lower entropy. 

We now show that the entropy change of the weight in 
any particular protocol may be made as small as desired 
by choosing its initial state to be a sufficiently broad pure 
state (e.g. a state with wavefunction ipii^) equal to 



Xj-JlL for |x| < Z., and otherwise, where L ^ 1). First 
note that the requirement that transformations are transla- 
tionally invariant on the weight means that they have the 
form given in (A5). When applied to a thermal state of the 
bath, the effect of the protocol on the weight is to trans- 
form it into a finite mixture of translations of the initial state 
Pw = llijPij^E,-E.\'pL)S'pL\^E.-E,' where p^j are proba- 
bilities and z and ; label energy eigenstates (of energies 
and Ej) of the bath. If the thermal systems used in the 
protocol have total dimension d, and the initial state of the 
weight is pure, then the final state of the weight lies in a d^- 
dimensional subspace spanned by the states T ^ _^\ipj)w for 

i,ie{l,2,...d}}. 

As the final state of the weight lives in a finite dimensional 
subspace, its entropy can be shown to be continuous due to 
Fannes' inequality [34] . 

\s{pJ-s{\^,)Sh\)\<DH(^-^^ (Bi) 

where D is the trace distance between p^ and \<pj) {ipiY We 
can make D as small as we like by taking sufficiently large L 
and therefore make the entropy change as small as we like. 
For the case in hand, a straightforward calculation shows 
that D < y/^^, where a — max^y \E- — Ej \ is the maximum 
energy gap of the system-bath Hamiltonian. 

Note that all of the above arguments apply equally well if 
we consider a system in addition to the bath which is initially 
in a mixture of energy eigenstates, as considered in Section 
IV E. 



Appendix C: Motivating example details 

In this appendix we shall provide more details into the ex- 
ample of Section IV A, where a state undergoes a transforma- 
tion and in the process supplies an amount of work W . 

Consider the state 

/'5-(l-/')|0>,(0| + /'|l>,(l| (CI) 
with Hamiltonian i-/^ = £^11) (1|, along with a thermal qubit 

Tp{H,) = {\-r)\Q){Q\ + r\\)l,\\ (C2) 

with Hamiltonian Hg — Eg\l)^, where Eg — TS'J^r). Let 
us bring in a weight in the state |0) , and apply the unitary 
transformation [/, which interchanges 

|0)Jl)Jx)^^|l)jO)Jx+£,-£,)^ (C3) 
whilst leaving all other orthogonal states unchanged. Apply- 



12 



ing this unitary to the combined system we find that 

-r/,|l)Jl)jO) jl|^,(l| (0| 
+ r(l - />)|0)J1)J£, jO|^(l| (£, 

+ (1 - r)p|l)jO)J£, jl|^(0| -£,| 

+ (l-r)(l-/,)|0)jO)jO)^jO|^(0|jO| (C4) 

From this one can finds that the final reduced state of 
the system and bath qubit are p' — tr^^^a — Tp{Hg) and 
t' — tr^^a — respectively. Thus we see that at the level 
of reduced states these two systems have swapped states. The 
change in free energy of the system AF^ is 

AFp^Ff,ip)-FpiTf,iH,)) 

= ipE,-TS,ip))-irE,-TS,ir)) 
^{p-r)Es-T{SXp)-S,{r)) (C5) 

Moving on to the weight its final reduced state Vl'^ is 

^^ = {rp + {\-r){\-pmj,Q\ 

+ r{l-p)\E,-E,)j,E,-E,\ 

+ ^l_r)p\E,-E,)J,E,-E,\ (C6) 

The change in average energy of the weight A{E)^ is thus 

A(£)^-tr(//^,nj-tr(//^|0)(0|) 
= {p-r){Es-E,) 

= (p-r)iE,-TSXr)) (C7) 

Now, let us take r — p — $p and expand to second order in 
Sp both AFp andA(£)^, 

AFp = $piE, - TS[{p)) + 8p'^^ + 0{8p') (C8) 
A{E)^ = 8p{E, - TS[{p)) + 8p'TS'^{p) + 0{8p') (C9) 

The change in free energy and the change in average en- 
ergy of the weight thus coincide to first order in 8p and dif- 
fer only by a factor of 2 in the second order term. Since 
S'^{p) < 0, we see immediately that A{E)^ < AFp, so that 
the change in free energy is always larger than the change in 
average energy of the weight, as we would expect. 

Appendix D: Calculating the average energy and spread 

In this appendix we will show how to arrive at equation 
(1 1) for the asymptotic state of the ladder. To do so let us 
consider first those instances where the system qubits starts 
in state |0) . Given this we shall then calculate the expected 
energy of the weight and its variance in the limit of large N 
to first order, from which we shall be able to conclude that 
it approaches a definitive value in the asymptotic limit at the 



desired energy. A analogous method can also be employed 
assuming the system starts instead in the state |1)^, with the 
desired result also obtained. 

By calculating the first few stages of the protocol and then 
by induction it is easy to show that the expected energy of 
the weight at the end of the protocol is 

{E)^!}—Pe,Es + pE^'+±{q^'^-q^'-'^)Ef (Dl) 

where the superscript [0] is a reminder that this is the case 
for the system starting in the state |0)^, and as defined in the 
main text we have 



1-?' 



By expanding the logarithms in powers of and denoting 
a — (p^^ — p), after some basic manipulations this can be 
re-written as 



{E)':'—P.,Es+pEi^^ + ^pH{^-f) 
a / 1 / ak \" 1 /-ak\" 



f^^ttttX n\{l-p)N 



+ ■ 



pN 



The advantage of performing this expansion is that we can 
now interchange the order of summation and note that the 
only term which depends upon k is the term k" which is 
common to both terms in the sum. We can thus use the 
expansion 



N 



+ — + 0{N" 

n + l 2 



(D4) 



to write 



{E)^'=-Pe,Es + pE':' + fH{'-f) 
£ - /I 1 \ / 



1 1 

■ + 



+^'(t7i) m 



This sum can now be evaluated explicitly, and after re- 
expressing E^ in terms of S'^{p^^), expanding i;^'' to first or- 
der in powers of ^, and an amount of manipulation we ar- 
rive at 



-Kip))-^)h + ^{w) (D6) 

thus demonstrating that the weight is peaked around the 
point expected when the system starts off in the state |0)^ 
with an offset which vanishes in the asymptotic limit. 
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Considering the case now when the system starts off in 
the state |1)^ and again calculating the first few stages of the 
protocol and then by induction it can be shown that 

Thus by re-expressing in terms of S'^{p^^) and expanding 

E^^'^ to first order it is straightforward given the previous re- 
sults to show that 

which again gives the desired result. Let us move on now to a 
calculation of the variance AE^^''^ — lE^)^'^ - lEV^'^ of each 
of the two packets, where for simplicity we will neglect the 
finite width of the initial wavepacket. Again by induction it 
can be shown that the spread of both packets is identical (and 
hence we shall drop the superscript [i]) and equal to 



k=i 



Let us consider the k'^ term in this sum, multiplied by N. 
Defining x — jj and expanding this summand in terms of 
we find 



^ np.,-pf , 

iP + <Pe, - Pm -P- <Pe, - P))N' ^ ^ ^' ^ 

pio) 

Thus for large N the leading order contribution to this sum 
becomes equal to 



AE^ ~ 



N 



npe,-pYd> 



iP + <Pea - PW -P- <Pea ' P)) 



Evaluating this integral explicitly we find finally that 



N 



pil) 



P12) 



Thus we see that each peak has a spread of the order of 1/ 'JN 
which vanishes in the asymptotic limit N — » oo. Therefore in 
this limit we can conclude that the distribution of the ladder 
approaches a two-peaked distribution, as given by equation 
(11). 



Appendix E: Extracting work from diagonal quantum systems 
of arbitrary dimension 

In this appendix we wish to show that the average 
work extracted when moving the occupation probability be- 
tween energy levels is still equal to the free energy in a d- 
dimensional system. It will suffice to consider a qutrit, and 



moving probability 8p from the ground state |0)^ to the sec- 
ond excited state |2)^ . 

Let us take our system to be initially in the state 

Ps^{l-P- ?)|0)jO| +^|1)^(1| + p\2)l2\, (El) 
and thus to end in the state 

p'^ = {l-p-q- .^;,)|0)^,(0| +^| 1)^(1| +(^ + 8p)\2)l2\. (E2) 

where the system Hamiltonian is 

H,=E,\\)l\\+E,\2)i2\. (E3) 

To achieve this, we append a bath qubit with energy level 
spacing Eg and ground state population r and apply the uni- 
tary transformation which interchanges only the states 

|l)J°)s>l^l°)J2).>+^fi-^2)„, (E4) 
This induces on the system and weight the transformation 

+ ^|l)j0)^^(l|j0| + ;,r|2)j0)_^/2|j0| 
+ p{X-r)\0)^\E,-E,)J}\l,E,-E,\ 
+ {\-p-q)r\2)^\E,-E^)j2\J,E,-E^\ (E5) 

where we now carry out the final trace over the bath qubit 
for brevity of presentation. Thus in order that the final re- 
duced state of the system is p'^ we find that the ground state 
population of the bath must be chosen to be 

P + ^P 

r ^ (E6) 

l-q 

The denominator is the total probability to be in either of 
the states |0)^ or |1) , and hence this expression can be seen 
as a renormalised version of the qubit case, where the total 
probability to be in either state always sums to unity. We 
see that it is the ratio of probabilities which must be close 
to the ratio of populations of the thermal qubits, which is 
equivalent to saying that they must be close in temperature 
(see Sec. VI). 

The change in energy of the weight is given by 

$W = ip-il-q)r)iE,-E,) 

^-8p{E,-E,) (E7) 

thus using the fact that Eg — ■^S'^{r) and expanding to first 

order in $p we find that the work extracted from the system 
is given by 



(E8) 



which a straightforward calculation verifies is equal to the 
change in free energy F{p^) — F{p'^) to first order in $p. If 
we do a sequence of N such transitions between the states p 
and a, in each of which $p — ff{l/N), then we will obtain 
SW = F{ps) - F{pj:) + &{l/N). In the asymptotic limit 

in which the number of thermal qubits N goes to infinity, 
we will therefore extract average free energy equal to the free 
energy change. 
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Appendix F: Work extraction from coherence 



2. General work extraction protocol 



In this appendix we will present the full details for how 
work can be extracted from coherence. We shall first con- 
sider the special case presented in the main text for n systems, 
and then move on to the general case. 



1. Motivating example 



Consider n copies of |^)^, where 

l^^),--/l^|0), + v/^|l), (Fl) 

There will be w -|- 1 energy eigenspaces with energies kE^, 
k — 0,...,n. The dimension of the eigenspace with en- 
ergy kEi^ will be (2)- After collective-dephasing in each 
eigenspace the system will be a pure superposition over all 
states, and the probability to be in each eigenspace will be 
ik) Peq^^~ Peq)''"~^^ ■ ^^^^ causs the State to 'isothermally 
expand' in each degenerate subspace, taking the state from 
the initial pure state to the final maximally mixed state and 
in the process extracting T log d energy from the bath, where 
d is the dimension of the subspace. In total, the final average 
energy of the ladder will be 



k=0 



(F2) 



In the asymptotic limit, as n 
show that 



1 



oo it is straightforward to 



k=0 ^ 



since in the limit the only contribution to the sum comes 
from k — np^^. We thus see that asymptotically the ex- 
pected amount of work is extracted. There are a couple 
of comments which are worth mentioning. First we note 
that due to concentration effects, we know that almost all 
weight lies in those subspaces with energy np^^ ± Oi^^fn). 
We could therefore ignore those subspaces which lie outside 
this range and obtain, to leading order, the same amount of 
work. The results obtain however are independent of the 
concentration effects. Second we recall that the protocol 
starts with collective-dephasing in the energy eigenbasis. It 
might appear that this operation, which changes the entropy 
of the system, throws away work. However, asymptotically 
we obtain to first order the optimal amount of work, and so 
we conclude that the amount thrown away must scale sub- 
linearly in w. In fact the amount of entropy thrown away 
is only ^^(logw), the entropy of the binomial distribution, 
since the dephasing leaves the system binomially distributed 
amongst energy eigenspaces which have orthogonal support. 
This shows that asymptotically the coherence between states 
of different energy are thermodynamically insignificant. 



Finally, for the case of arbitrary states of arbitrary dimen- 
sion (i, we note that the same conclusion can also be drawn. 
First we need to show that the operation of collective- 
dephasing never increases the entropy of a collection of sys- 
tems too much in the asymptotic limit. Let us denote the 
projectors onto the energy eigenspaces by 11^, and the total 
number of different energies by K. After the operation of 
collective-dephasing the state becomes block diagonal in the 
energy eigenbasis, namely 



K-\ 



(F4) 



We are interested in the difference in entropy S{p'^") — S{p'), 
i.e. the entropy generated by this operation. To do so, let us 
first consider the coherent version of collective-dephasing. 
Let us introduce an ancillary system A with K states |z)^ 

prepared initially in the state |0) . Let us also consider the 
unitary operation V 



V = ^Ill^i^\z + k mod K)^{z\ 



(F5) 



Applied to the state p^^ = p^" ® |0)J0| this performs the 
transformation 

V {p^" ® |0)jO|) V1- = p'^^ ^Y.^.P^"^,, ® \k)^{k'\ (F6) 

It is straightforward to see that tr^^^^ = p' whilst 

trsp',^ = p'^^Y.'r(jl,p<^")\k\{k\ (F7) 

k 

Considering now the entropies, we have 
^^p'sa) ~ ^{p^") — nS{p), since the two states dif- 
fer by the appended pure ancilla and the joint unitary 
transformation. Thus, from the Araki-Lieb inequality 

S{Psa) > \KPs)-^iPA)\ we have 

nS{p)>\S{p')-S{p\)\ (F8) 
Next, note that we can rewrite p' in the form 

^kP^"'^k 



p' = Y,tr{Il,pn 



tr(n,^®") 



(F9) 



where the sum is restricted to those k for which 
tr(n^^®") / 0. Comparing this to (F7), we note that 
^{p') ^ ^{p'a)' ^ ^ mixture of orthogonal mixed states al- 
ways has higher entropy than the same mixture of orthogo- 
nal pure states. Hence the absolute value can be omitted on 
the right-hand-side of equation (F8) and after rearranging we 
get 



S{p')>S{p')-nS{p) 



(FIO) 
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Next, note that S{p'^ < \ogK, since in the worst case p'^^ is 
maximally mixed over K states. Hence we find 



\ogK>S{p')-nS{p) 



(Fll) 



The number of different energy levels K is upper bounded 
by the number of ways of distributing n indistinguishable 
particles between d distinguishable energy levels, which is 



given by 



1+d-l 



).Thus 



such that 



(G4) 



where the m'^^^ are integers, and we take the smallest possible 
s'^^^ possible such that this condition is met, meaning that 
|fW|<<f. 

To proceed, we first note that (Dl) can alternatively be 
re-written as 



S{p')-nS{p)<\og{^^'^^ <(J_l)log(„ + l) (F12) 

This demonstrates that the operation of collective- 
dephasing on n qubits can only increase the entropy by a 
logarithmic amount in n. The increase per qubit is thus of 
the order log(w + 1), which vanishes in the asymptotic 
limit. This result does not follow from any concentration of 
measure, but simply by the fact that the the number of en- 
ergy eigenvalues of n non-interacting systems is logarithmic 
in n. 



Appendix G: Discrete work storage 

In this appendix we will show that the energy level spacing 
of the weight need only become continuous in the asymp- 
totic limit and that for any finite number of bath qubits N it 
is sufficient to consider the levels to have a minimum spacing 
S which scales as l/N^. 

Let us begin by recalling how the protocol works. We 
pick a collection of N bath qubits which have excited state 
probabilities q'^^'^ given by 



■P) 



(Gl) 



and therefore excited state energies M*^'^r5'(^W). At each 
stage of the protocol the weight either gains or loses energy 

Let us now assume instead that the of being a continuous 
degree of freedom that the weight has a discrete (but infinite) 
set of states \k) and Hamiltonian 



(G2) 



Accordingly, we shall adjust the energy levels of the bath 
qubits to 



(G3) 



N-\ 



(G5) 



Thus upon making the replacement i;^^' — »■ E"^^ for the case 
of a discrete weight, the average energy, conditional on the 
qubit starting in the ground state becomes 



7ik) . 



N-l 

k=0 



N-l 



k=0 



N-l 



k=Q 



(G6) 



k=Q 



It is the final term in the last line which is the error intro- 
duced by considering a discrete weight, and thus it is the 
magnitude of this term which is of interest. This can easily 
be bounded as follows 



N-l 



k=0 



N-l 

k-Q 
N-l 



^(k) _ ^{k+i) 



^S{{p+Pe,)^ + {P-Pe,)) (G7) 

Therefore as long as the product §N — »■ as A/ — »■ oo, then 
this term will asymptotically vanish. Choosing § — (/N^ 
would ensure that this correction is ff{l/N) and thus the 
same order as the leading order correction to (-E)^^} for finite 
N. An identical analysis holds also for {E)]^\ the average 
energy of the weight conditional on the system starting in 
the state 1 1) , and therefore we conclude that the results more 
generally do not rely crucially on the continuous nature of 
the weight. 



